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Preface 



• / 



On July 15-16, 1999, a group of 20 
higher education leaders gathered in 
Roanoke, Virginia to participate in an 
invitational symposium on the topic of 
“Redesigning More Productive Learning 
Environments.” This was the first of the 
recently created Pew Symposia in Learn- 
ing and Technology, whose purpose is 
to conduct an ongoing national conver- 
sation about issues related to the inter- 
section of learning and technology. 

The discussion in Roanoke consisted 
of two kinds of participants. The first 
group had practitioners, faculty mem- 
bers, and campus administrators who 
have undertaken large-scale redesign 
projects. The second group had national 
and campus leaders who are intensely 
concerned about the issues of quality 
and cost in higher education and are 
looking to information technology as 
an innovative resource for constructive 
change. By blending the macro and 
micro views of the issues, we hoped to 
arrive at a common understanding. 

In higher education, we traditionally 
have assumed that high quality means 
low student-faculty ratios and that large 
lecture/presentation techniques are the 
only low-cost alternatives available to 
us. New models are emerging, however, 
that show that it is possible to improve 
learning while simultaneously reducing 
the cost of instruction. We can indeed 
have our cake and eat it too. 

Our goal in Roanoke was to examine the 
validity of the conceptual framework 
that undergirds the projects being imple- 
mented in the Pew Grant Program in 
Course Redesign. The purpose of this 



program is to encourage colleges and 
universities to redesign their instruc- 
tional approaches using technology to 
achieve cost savings as well as quality 
enhancements. Redesign projects focus 
on large-enrollment, introductory 
courses. There are, of course, many 
other ways to improve quality and 
reduce costs in higher education — some 
of which use technology and others 
which do not — including efforts at the 
program level, the institutional level and 
the interinstitutional level. Our discus- 
sion, like the grant program, had as its 
focus the course level, specifically the 
introductory course level for reasons 
that are articulated in this paper. 

Among the questions considered at the 
symposium were the following: What 
prior experience and investment makes 
an institution ready to engage in 
redesign? How are the new learning 
paradigms organized? How can they be 
improved? What benefits do they offer 
for students, for faculty and for institu- 
tions? What is the best approach to 
helping faculty adapt to a different style 
of educational delivery? What are the 
elements necessary for successful imple- 
mentation? Are there best practices that 
we can draw upon to serve as models for 
other disciplines and institutions? Will 
these redesigns scale beyond a particular 
class or institution? 

This paper, like the discussion in 
Roanoke, builds on the existing theory 
of how to redesign more productive 
learning environments, which is well 
established. Much has been written on 
this subject by Robert C. Heterick, Jr., 

D. Bruce Johnstone, Charles Karelis, 




William Massy, Jack Wilson, Robert 
Zemsky, and me, all of us advancing 
essentially the same argument. Despite 
the existence of a good theoretical base, 
those ideas have had very little impact 
within the higher education community. 

A major contributor to this minimal 
impact is that those in higher education 
who sincerely want to address this 
complex issue may not be convinced that 
it can be done or may not know how to 
do it. Two things are needed: 1) a com- 
prehensive planning methodology (a 
roadmap or a cookbook, as some have 
called it) that can guide course redesign 
for multiple institutions, and 2) exam- 
ples of practice that prove the theory. 
Rather than rehash either the reason for 
taking action or the theory that points 
the way, our discussion focused on 
specific ways to implement the theory, 
drawing upon the experience of four 
large-scale redesign projects at Virginia 
Tech, the University of Wisconsin- 
Madison, Rensselaer Polytechnic 
Institute, and the University of Illinois 
at Urbana-Champaign. By iterating 
between the planning methodology and 
actual implementations, our intention 
was to draw lessons that can be used as 
a guide to practice throughout higher 
education. This paper represents the 
result. 
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THE PEW SYMPOSIA IN LEARNING AND TECHNOLOGY 



Quality, Cost and Information Technology 



A major problem that continues to confront American higher 
education is that of rising costs. With the average cost of 
attendance consuming a substantial portion of the median 
family income, what is at stake for many Americans is 
nothing less than the continued viability of the American 
dream. The stakes are high for higher education as well. 
Caught in a closing vise between new demands for enrollment 
and declining rates of revenue growth, colleges and universi- 
ties must figure out a way to do more with less. 

Recognizing that tuition increases can no longer be used as a 
safety valve to avoid dealing with the underlying issues of why 
costs increase so much, campuses have begun the hard work 
of cost containment. But after sharpening priorities, some- 
times making tough choices in light of those priorities, and 
asking everyone — administrators and faculty alike — to work 
harder, campuses are still groping for ways to wrestle costs 
under control. 

At the same time, colleges and universities are discovering 
exciting new ways of using technology to enhance the process 
of teaching and learning and to extend access to higher edu- 
cation to new populations of students. For most institutions, 
however, new technologies represent a black hole of addition- 
al expense as students, parents, and faculty alike demand 
access to each new generation of equipment and software. 
Most campuses have bolted on new technologies to a fixed 
plant, a fixed faculty, and a fixed notion of classroom instruc- 
tion. Under these circumstances, technology becomes part of 
the problem rather than part of the solution of cost contain- 
ment. By and large, colleges and universities have not yet 
begun to grab hold of technology’s promise to reduce the 
costs of instruction. 

Containing costs — and making use of new technologies to 
help contain costs — requires a fundamental shift in thinking. 
It requires one to challenge the fundamental assumption of 
the current instructional model: that faculty members meet- 
ing with groups of students at regularly scheduled times and 
places is the only way to achieve effective student learning. 
Rather than focus on how to provide more effective and 
efficient teaching, colleges and universities must focus on how 
to produce more effective and efficient student learning. 



Faculty are only one of many resources that are important 
to student learning. Once learning becomes the central focus, 
the important question is how best to use all available 
resources — including faculty time and technology — to 
achieve certain learning objectives. Rather than asking faculty 
to work harder, we need to enable them to work smarter. 

Responsible members of the higher education community 
have an interest in lowering the cost of instruction as long 
as such an effort does not result in a reduction in quality. 
Different stakeholders are interested in reducing costs for 
different reasons. Some are concerned with reducing the cost 
to society — such as the level of state and federal allocations to 
higher education; others want to reduce the cost for students 
and their parents — such as the level of tuition and fees. Both 
of those views tend to come from stakeholders outside the 
institution. 

Within the institution, there are other reasons for wanting to 
reduce costs. The belt-tightening activities of the past decade 
have left many institutions with almost no discretionary 
funds; life on many campuses has an almost austere quality. 
Institutions are faced with the pressure to invest more in 
information technology but many are hard-pressed to find ad- 
ditional funds for such investments. Finally, those in higher 
education most threatened by the growth of private sector 
competition need to find more cost-effective methods of 
operation in order to maintain their position in the new 
marketplace. 

Assumptions that get in the way 

Having said that, a series of assumptions about the relation- 
ship among quality, cost, and information technology 
dominates the current discussion, making it difficult to find 
a solution to the problem. Three of these assumptions are: 

> Improving quality means increasing cost. 

Conversely, controlling costs means reducing quality (for 
example, relying on large lecture courses); increasing the use 
of adjuncts, teaching assistants (TAs) and other part-time 
faculty; or, most drastically, laying off faculty. Very few people 
in higher education believe that it is possible to increase 
quality and reduce cost at the same time. 
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Adding information technology to the mix only 
increases higher education’s cost. 

Very few believe that investments in IT can generate a return 
on that investment, not only in terms of increased quality but 
also in reduced costs. 

>■ The use of IT in higher education may even 
threaten quality. 

This belief generally stems from the fear that IT will be used to 
reduce costs by reducing human contact (or replacing human 
contact). This fear gets expressed in a variety of ways: the 
American Federation of Teacher’s recent ad campaign about 
the “Five-Minute University;” the breakdown-in-community 
argument; and the no-proof argument — “no one has shown 
that technology can improve learning.” Since education is a 
human or social practice, and it has primarily been practiced 
in face-to-face settings, physical contact becomes the primary 
enabler of learning. 

In contrast, we will show how redesign using technology- 
based or learner-centered principles can offer a way out of 
higher education’s historical trade-off between cost and quali- 
ty. Many experts on the subject have pointed out that moving 
away from our current credit-for-contact mode of instruction 
is fundamental. Some approaches employ a greater reliance 
on asynchronous, self-paced learning modes while others take 
place in a traditional, synchronous classroom setting but with 
reduced student/faculty contact hours. Both rely on shifting 
faculty time-on-task to the technology or lessening the labor- 
intensive quality of instruction. In each case, they are designed 
to transfer the locus of activity from the faculty to the student: 
the focus is on student problem solving and interactive learn- 
ing rather than on presentation of material. 

A Strategic focus 

In order to have maximum impact and to achieve the highest 
possible return on one’s investment, redesign efforts need to 
have a strategic focus. Like the Pew Grant Program in Course 
Redesign, the symposium had as its focus large introductory 
courses with high enrollments. Why concentrate on those 
courses? Studies have shown that undergraduate enrollments 
are concentrated in relatively few academic areas. At the 
community college level, about 50 percent of student enroll- 
ment is concentrated in just 25 courses. The course titles 
include introductory studies in English, mathematics, 
psychology, sociology, economics, accounting, biology, and 
chemistry. Those same 25 courses generate about 35 percent 
of enrollment at the baccalaureate level. By making improve- 



ments in a restricted number of courses, one can impact 
literally every student in the institution. 

In addition to having an impact on large numbers of students, 
there are other advantages of such a focus. First, large intro- 
ductory courses are good prospects for technology-enhanced 
redesign because they have a more or less standardized 
curriculum, outcomes that can be easily delineated, and 
content over which faculty are less possessive. Second, by 
targeting those courses, what is widely regarded as a prime 
area of ineffective teaching — the large lecture course — will be 
improved. Third, those courses serve as foundation studies for 
future majors. Successful learning experiences in them will 
influence students to persist in key disciplines like the 
sciences. Finally, because those courses are feeders to other 
disciplines, acquiring a deeper foundation and mastery in 
them will help students make a successful transition to more 
advanced study. 

Finally, introductory courses absorb a significant amount of 
resources. Despite the common wisdom that packed lecture 
halls and low-paid graduate teaching assistants equal the most 
cost-effective way to deal with large numbers of students, 
those who have examined the matter know that lecture-based 
courses are not cheap. This is especially true when they are 
combined with discussion sections — employed by most 
institutions to give students some opportunity for interac- 
tion — as well as laboratories. In many institutions, intro- 
ductory courses are taught in multiple section models by 
individual faculty members, quite costly given the large 
number of sections required. Controlling costs in those 
courses can result in a significant return to the institution. 

In order to be successful in redesign efforts, one must pay 
attention to three critical interrelated elements: 

>" the importance of readiness at both the institutional and 
course level, 

'>■ the need to focus on improving student learning, and 
the need to do detailed financial planning. 

What follows is an elaborated discussion of each of these. 
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Case Study: University of Wisconsin-Madison 

Individualizing Instruction in Introductory Chemistry 




The University of Wisconsin-Madison is in the process of 
redesigning its two-course general chemistry sequence. 
About half of the freshman class enrolls in the fall semes- 
ter (about 2300 students), and more than a third enroll 
in the spring semester (about 1700). There are eight 
sections of the course of about 250-350 students per 
section. Each section is taught by one professor, assisted 
by eight TAs. Students attend two one-hour lectures, two 
one-hour discussions, one two-hour lab and one one-hour 
quiz/exam session per week. 

The traditional course faces the following academic 
problems. 

> Inconsistent student academic preparation 
in chemistry 

> Inability to accommodate different student 
learning styles 

> Inadequate student interaction with learning 
materials 

> Difficulty in tracking multiple student experiences 

> A 15 percent rate of failures, D grades and drops 

> Inability of students to retain what they have 
learned 

> Inability of students to apply chemical principles 
to other disciplines. 

The course redesign involves eliminating one lecture and 
one discussion period per week and substituting for them 
a modularized system of online, diagnostic homework 
exercises, tutorials, and quizzes. This system will allow 
students to determine what they do not know and then 
study intensively those areas where they are weak. The 
homework will define the content students must master 
each week and will provide students with directions to 
other materials, including text materials and computer- 
based tutorials, that will help them achieve mastery. 
Quizzes will test students^ mastery of the material each 
week. Out-of-class activities will prepare students to make 
the most of in-class interactions with TAs and other 
students. 

The redesigned course will: 

> enhance quality by individualizing instruction, 
thereby addressing the problem of varying 
student backgrounds; 



> assess students' knowledge in much smaller 
subject-matter chunks; 

> provide students with feedback and direction that 
will allow them to make up for specific deficiencies 
by means of extra work and effort; 

> help students learn to identify their own deficiencies 
and do their own remediation, a good habit for life- 
long learners to develop; 

> incorporate examples and information from other 
disciplines that will help students see the applica- 
tions of the chemistry they are learning; and, 

> provide a means by which chemistry can be 
reviewed by students in subsequent courses. 

The impact of the course redesign on student learning 
will be assessed by comparing experimental and control 
groups, such as online and traditional sections, in terms 
of student performance on course tests and final course 
grades; administering a national exam designed to test 
conceptual understanding; tracking course completion 
and retention rates; and evaluating student success in 
subsequent courses. 

Significant savings can be achieved in the time spent by 
faculty and teaching assistants in the general chemistry 
course, which translates to significant cost savings. By 
substituting technology-based materials for time spent by 
faculty and teaching assistants, UW-Madison expects to 
reduce the cost-per-student from about $257 to $185, a 
reduction of 28 percent. Because this course affects 
4,100 students per year, this saving translates to annual 
savings of approximately $295,000. 
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Institutional Readiness Criteria 



Not all institutions are ready to engage in large-scale redesign 
using technology. Experience has taught us that certain insti- 
tutions more than others have progressed farther along the 
learning curve of what is required in order to create these new 
learning environments. Because of their prior investments 
and experiences, some institutions are, in essence, more ready 
to engage in successful redesign efforts. What follows is a list 
of preconditions — or readiness criteria — that must be in 
place before an institution is able to implement such an effort 
successfully. 

The institution must want to reduce costs and 
increase academic productivity. 

It is questionable how many institutions really want to reduce 
or control costs. Many, for example, believe that rich inputs 
are characteristic of high quality and have built their reputa- 
tions on that view. Others recognize that increasing academic 
productivity is key to their future prosperity and have made 
public statements to that effect. 

For many institutions the prospect of increased enrollment 
demands without a commensurate growth in resources is the 
driving factor. For public institutions, declining state support 
also contributes to the desire to increase productivity. Some 
institutions’ operating budgets have remained flat at levels 
that existed in the mid-1980s. They face the challenge of 
offering quality instruction to a steadily growing student body 
with limited resources and with reduced staff To do so, many 
are investigating the use of technology to achieve more 
efficient and cost-effective instructional delivery. 

Numerous institutions throughout the country face similar 
predicaments. Some, unlike those mentioned above, prefer to 
hope for better financial times rather than deal with higher 
education’s new economic reality. They are like alcoholics in 
denial. To be successful in using technology to reduce costs, 
institutions must begin by owning the problem. Just as the 
only alcoholics who can be helped by Alcoholics Anonymous 
are those who want to stop drinking, so too must institutions 
want to reduce costs in order to take the next step. 



The institution must view technology as a way 
to achieve strategic academic goals rather than 
as a general resource for all faculty and for all 
courses. 

Almost every college and university in the country provides 
some kind of support for faculty to integrate technology into 
teaching and learning. Most, however, stop there without 
thinking more deeply about how the use of technology enables 
the institution to achieve its strategic goals. Fewer still focus 
on specific elements of the curriculum to achieve maximum 
impact. Does your institutional strategic plan differentiate 
between general support for faculty and students and strategic 
applications of technology in the academic program? 

Several universities have made integration of IT into the 
teaching and learning process a central strategic goal. Such 
integration has strong support from both faculty and campus 
executives. In each instance, the campus has gone beyond 
crafting an IT plan, to thinking about IT in the context of 
institutional planning. A few campuses have moved to target 
specific, strategic parts of the curriculum. While continuing 
to provide general support for instructional technology, these 
institutions have taken an important step in moving beyond 
the support-whoever-walks-in-the-door approach that 
characterizes most campus efforts. 

In contrast, campus-planning weaknesses can easily be 
spotted when generalities predominate planning statements. 
Many campuses express the desire to integrate appropriate 
technology into the academic program without defining 
what is appropriate. Other seek to use technology to achieve 
academic goals without making explicit what those goals 
are. Some want to reconceptualize undergraduate education 
but are woefully silent when it comes to defining how they will 
do it. Many see technology use as a means to encourage 
collaboration as if collaboration like innovation is an end 
in itself. Collaboration for what purpose? To what end? And 
almost everyone wants to use technology to support 
excellence. 
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The institution's goal must be to integrate com- 
puting into the campus culture. 

Ubiquitous networked computing is a prerequisite to 
achieving a return on institutional investment. One really 
does have to spend money to make money. The University 
of Illinois at Urbana-Champaign, for example, describes itself 
as a computing-intensive campus. What characterizes a com- 
puting-intensive campus? 

Anatole France said, “Those who don't count, don’t count.'* In 
this arena, his comment has merit. Unlike many institutions 
who have established initiatives without specific milestones, 
computing-intensive campuses know the numbers. They 
know the level of network access and personal computer 
ownership (or availability) for students and faculty on their 
campuses because their goal is saturation; the numbers tell 
them how far along they are in achieving that goal. 

Until all members of the campus community have full access 
to IT resources, it is difficult to implement significant redesign 
projects. A robust IT infrastructure is a necessary prerequisite. 

The institution must have a mature information 
technology (IT) organization(s) to support 
faculty integration of technology into courses 
or it must contract with external providers to 
provide such support. 

How does one characterize a mature organization? It means 
that the IT organization can provide more than technical 
support. It has an understanding of the goals and objectives 
of the institution’s academic program — it can see the big 
picture. More advanced IT organizations include instructional 
design capabilities and have specific experience with support- 
ing course redesign. 

Not all campuses need to develop their own in-house units. 
Another approach is to contract with one of the growing num- 
ber of external service providers who have specific expertise 
in developing online learning environments. Campuses today 
no longer develop their own administrative applications. 
Instead, they turn to contractors, not only to develop sophisti- 
cated and integrated modular administrative systems, but 
also to help implement and manage such systems. Before 
starting down the path of growing their own instructional 
products and services, campuses should think carefully about 
whether to build or buy. They should also take care not to 
confuse technical support with instructional design support, 
whether its source is on or off campus. 



A substantial number of the institution's faculty 
members must have an understanding of and 
some experience with integrating elements of 
computer-based instruction into existing courses. 

Some faculty may have a great deal of enthusiasm for large- 
scale redesign but little prior experience in this area. It is 
difficult to complete a successful large-scale redesign project 
by starting from scratch. Having experience with integrating 
smaller IT elements into courses helps faculty to prepare 
for large-scale redesign efforts. Some experts have said that 
13 to 15 percent of the faculty constitutes critical mass. 

Once again, knowing the numbers matters. Less-developed 
campuses can only cite goals and plans for faculty involvement 
or participation in training and development workshops 
without any clear idea about how such training experiences 
translate into new kinds of learning experiences for students. 

The institution must have a demonstrated 
commitment to learner-centered education. 

What are some indicators of institutional commitment to 
learner-centered education? Implementing teaching-learning 
models where (1) the locus of activity has shifted fundamen- 
tally from the instructor to the learner and (2) student en- 
gagement independent of time and location is not only per- 
mitted but also promoted would be one example. Non-tech- 
nology-based commitments to student-centered learning also 
constitute evidence. 

Community colleges often have a clearer commitment to 
learner-centered education than other sectors because of the 
emphasis of their missions. For example, part of Miami-Dade 
Community College’s mission is to “provide accessible, 
affordable, high quality education by keeping the learner’s 
needs at the center of the decision-making process.” The 
College recognizes that students are different and, therefore, 
should have available a variety of modalities that support their 
academic, personal and career development. 

Some institutions demonstrate their commitment to learner- 
centered education by pointing to the range of pedagogical 
practices they use to address the variety of student learning 
styles. These include distance learning, self-paced modules, 
learning communities, and collaborative learning. Others 
show their commitment to learner-centered education by 
providing anytime-and-anywhere connectivity to a virtual 
learning environment, enabling both traditional and distant 
learners to access teaching and learning resources, tools and 
student information. 
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Even though the entire campus may not have embraced a 
learner-centered viewpoint, different types of indicators can 
be found that show movement in that direction. Promoting 
active learning approaches through faculty retreats and 
internal funding programs are examples of ways to involve 
dedicated and experienced instructors in the diffusion of 
learner-centered approaches. 

The institution must have established ways to 
assess and provide for learner readiness to 
engage in IT-based courses. 

Learner readiness involves more than access to computers 
and to the network. How computer literate and network savvy 
are your students? Does the institution have processes in place 
that enable them to gain these competencies if they are 
lacking? Readiness also involves access to support for such 
things as using navigation tools and course management 
systems. In addition to technical proficiencies, students need 
to be aware of what is required to be successful in technology- 
intensive courses. Does the institution have processes in place 
that assist them in making wise choices and that prepare them 
for success? 

Making a major change from face-to-face instruction to online 
learning involves far more than learning to use a computer. 
Like all of us, many students are set in their ways after a 
lifetime (albeit brief) of passive instruction. They need prepa- 
ration in making the transition to more active learning envi- 
ronments that are technology based. Some students instinc- 
tively flourish in those new environments while others require 
direct intervention and assistance from faculty and staff. 

Among the possible ways to assure learner-readiness are: 

>“ listing technology requirements for Web-based 
courses in schedules; 

>“ creating opportunities for students to assess the skills 
that are necessary for success in Web-based courses; 

>“ establishing Web-based or in-person orientation 
processes; 

>“ creating tutorials for first-time online students; 

>“ administering student learning styles assessments 
to help students determine what delivery modality 
(print, mixed/media, Web-based, or in-person) to 
enroll in for a particular class; 

>■ distributing student surveys to determine interventions 
that will help first-time online students; and. 



> instituting a calling program for first-time students 
to ascertain if they are experiencing difficulties. 

The institution must recognize that large-scale 
course redesign using information technology 
involves a partnership among faculty, IT staff, 
and administrators in both planning and 
execution. 

Substantive changes in the way courses are offered cannot rely 
on faculty initiative alone. They are systemic and involve 
changes in such institution-wide areas as policy, budgeting, 
administrative procedures, and infrastructure. Institutional 
policy regarding things like class meeting times and contact- 
hour requirements will require revision. In some instances, 
obtaining governance approvals maybe a prerequisite. 

While innovative faculty members have developed new 
methods and materials over many years, administrative 
initiative is required to bring development opportunities to 
the attention of the wider faculty and to provide the infra- 
structure and support that enable people to commit their time 
to course redesign. Curriculum oversight committees must 
learn to expect and encourage innovative course designs that 
break the traditional mold by providing flexible scheduling 
and contact requirements. 

In many cases, traditional budgeting processes do not 
welcome innovation and may need to be changed. Registrarial 
procedures such as registration and classroom assignment 
systems may need to be adjusted. Redesign may also require 
additional or unusual equipment purchases and deployment. 
Personnel policies regarding how instructors of nontradi- 
tional courses are compensated may require revision. How 
an initial large-scale redesign might benefit other courses in 
the institution also needs to be considered. The lesson of 
successful redesign is that faculty and administrative collabo- 
ration is required even in the planning stages. 

Institutions that have not recognized this interdependence 
view redesign as primarily a faculty matter — frequently as an 
individual faculty member’s task for his or her particular 
course — with some support from the IT organization. Such a 
view will inevitably resign institutional advancement to, in Bill 
Graves’ apt phrasing, “random acts of progress” rather than 
substantive accomplishment. And inevitably these efforts will 
be under-supported and incapable of generating a return on 
institutional investment. 
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Case Study: Virginia Tech 

Continuous Improvement in Teaching and Learning 




Virginia Tech's Math 1114; Linear Algebra, is a one- 
semester, two-credit course taken by first-year students 
in engineering, physical sciences, mathematics, and other 
majors. Its traditional format was similar to many large- 
enrollment, introductory courses taught at institutions 
nationwide. Organized in parallel sections of roughly 40 
students each. Math 1114 was taught by a mix of tenure- 
track faculty, instructors, and graduate teaching assis- 
tants. Each section met twice a week during the semester 
for 50-minute lectures; individual assistance was given 
during office hours and in review sessions for tests. 

Also like many large-enrollment, introductory courses. 
Math 1114 suffered from a number of academic prob- 
lems. First, the old format did not take into account the 
range of academic preparation and learning styles that 
students bring. For many, the material was easily 
learned; for others, difficulties arose due either to weak 
backgrounds in math or problems with the lecture format. 
Second was the problem of student retention: typically 
one group of students dropped the course early on while 
another group stayed registered but essentially gave up 
and stopped working. Third, there was a remarkable lack 
of uniformity in learning outcomes. Course grades across 
sections bore surprisingly little statistical relation either 
to SAT profiles or to scores on a common final exam. 
Finally, teachers in advanced math, engineering, and 
mechanics courses have expressed frustration at the 
inability of students who have passed Math 1114 to 
retain certain skills or recall material. 

The redesign of Math 1114 is part of a larger transform- 
ation involving all of Virginia Tech's introductory mathe- 
matics courses made possible by the creation of the Math 
Emporium, a 500-workstation learning center housed 
in 56,000 square feet of old retail space adjacent to 
campus. The redesign takes advantage of the Math 
Emporium's capabilities for online delivery of content 
modules and assessments in a flexible manner. The trans- 
formed course offers more options for self-directed study 
than are possible in traditional lecture-and-lab-based 
courses. The goals of the redesign are to improve learning 
productivity, raise learning-success rates, and increase 
retention of material for later use. 

In order to achieve those goals, the new course structure 
completely eliminates lectures and replaces them with 
Web-based resources such as interactive tutorials, compu- 



tational exercises, an electronic hyper-textbook, practice 
exercises with video solutions to frequently asked 
questions, applications, and online quizzes. The course 
material is organized into units that students cover at the 
rate of one or two per week, each ending with a short, 
electronically graded quiz. And because the Math 
Emporium is open 24 x 7, students are able to complete 
work on a flexible time schedule. Its peer tutors provide 
assistance and are available 75- to 80-hours per week. 
Ongoing data collection about student performance allows 
the faculty to make changes in the course as it proceeds. 

In this way, continuous improvement is a built-in feature 
of the system. 

Will the redesign enhance the quality of education for 
students? Evidence already exists that the Math 
Emporium is having a positive impact on the academic 
performance of mathematics students in general as well 
as on the morale of faculty members. Most strikingly, the 
university reports that scores in mathematics in general 
have risen 17.4 percent while the failure rate has dropped 
by 39 percent. The data show that courses utilizing the 
Emporium the most are those most likely to show positive 
improvement in student performance. 

According to data from Virginia Tech, the shift from a 
traditional course environment to a technology-based, 
student-centered learning environment shows not only 
measurable improvements in the quality of learning but 
also a measurable decrease in the cost of delivering the 
course. In the traditional configuration, the course 
requires 105 hours of instructional time per section to 
teach 1,520 students in the fall semester. To teach the 
38 sections of 40 students each requires 10 tenure-track 
faculty members at an average cost of $57 per hour, 

13 instructors at an average cost of $23 per hour, and 
15 graduate teaching assistants at $16 per hour. 

The savings anticipated by Virginia Tech are about 
$53 per student— from $77 to $24 — or $79,730 for the 
fall semester. Annual savings for all sections of Math 
1114 are expected to be $97,400. Increased success 
rates will yield additional savings by reducing the average 
number of course attempts per student. 
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Course Readiness Criteria 



Just as some institutions are more ready than others to engage 
in large-scale redesign, some courses are more ready than 
others to be the focus of that redesign effort. Because of prior 
experiences with technology-mediated teaching and learning, 
and because of numerous attitudinal factors, some faculty 
members are more ready to engage in large-scale redesign 
efforts. They have, in essence, a head start on the process. 
What follows is a list of preconditions that must be in place 
in order to identify a particular course as a successful redesign 
candidate. 

Improvements in the course potentially must 
have a high impact on the curriculum. 

Is the course a large introductory, high-enrollment course? Is 
it taught regularly? Is there a significant academic problem in 
the course such as a substantial failure rate? Does the course 
face a serious resource problem such as how to manage 
increased enrollment demand with no commensurate 
increase in resources? 

The course must offer the possibility of 
capital-for-labor substitution. 

Large size per se does not necessarily make a course a good 
candidate. The University of Illinois at Urbana-Champaign, 
for example, offers an introductory comparative literature 
course that enrolls about 250 students a semester. It is 
writing intensive and satisfies the campus composition 
requirement. In spite of the course size, the possibility for 
capital substitution is limited. Competent evaluators must 
assess the students’ written work that is contextually based, 
thus limiting the possibility of capital-for-labor substitution. 

Bill Massy has suggested that IT has strong potential to 
increase learning productivity in areas of codified knowledge 
and algorithmic skills. Examples of good target subjects 
include remedial and basic math and other basic general edu- 
cation courses. In those specific areas, the implication is that 
IT should supplement human instructors whenever possi- 
ble — human intervention should be oriented mainly towards 
making the advantages of IT accessible to all learners. 



Decisions about curriculum in the department, 
program, or school must be made collectively— 
in other words, beyond the individual faculty 
member level. 

Decisions to engage in large-scale course redesign cannot be 
left to an individual faculty member. He or she may leave the 
institution, grow tired of the innovation, change his or her 
mind, and so on. A collective commitment is a key factor for 
sustainability of a redesign project. 

Indicators that the faculty in a particular unit are ready to 
collaborate include the following: They may have engaged 
in joint conversations about the need for change; they may 
have decided to establish common learning objectives and 
processes for the course in question; they may have instituted 
pieces of a common approach such as a common final exami- 
nation. Institutional support is important, but departmental 
ownership of the course redesign idea is essential. 

If one wants to institute change, the best chance of success is 
to have a group of people who are committed to the project’s 
objectives working together rather a single individual. This is 
even more important when it comes to sustaining change. 

The faculty must be able and willing to 
incorporate existing curricular materials into 
the project in order to focus work on redesign 
issues rather than on materials creation. 

Disciplines with a comparatively large existing body of tech- 
nology-based curricular materials and/or assessment instru- 
ments are especially appropriate targets. The studio course 
model at Rensselaer relied initially on materials created by the 
nationwide CUPLE project. The chemistry redesign project at 
the University of Wisconsin-Madison builds on decades of 
collaborative work in chemistry software development. 

Faculty who are willing to employ an appropriate blend of 
home-grown (created by local faculty) and purchased 
learning materials in a non-dogmatic fashion will also have 
a head start. For example, Rio Salado is redesigning a mathe- 
matics course around Academic Systems interactive software 
that students purchase for themselves. In its Math Emporium 
project, Virginia Tech first tries to locate existing materials to 
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incorporate into its courses before turning to materials 
creation. Faculty who are subject to the not-invented-here 
syndrome, who believe that they must create everything 
themselves from scratch, will be consumed with materials 
development and add large amounts of time to the process. 
Those who are willing to partner with other content providers, 
whether commercial software producers or other universities 
who have developed technology-based materials, make better 
candidates for a large-scale redesign project. 

Project participants must have the requisite 
skills. 

Does the potential project have strong leadership? Champions 
or heroes frequently play a significant role in redesign 
projects. People need concrete evidence that an idea is doable 
as a way of starting, and having one person who can do some- 
thing that others can see is important. While the hero may be 
needed at first, the innovation will not grow and be sustained 
if the project continues to rely on heroism. Large-scale re- 
design efforts almost always will involve partnerships between 
faculty, IT staff, and others. 

Each of the parties in a redesign project must have the requi- 
site skills (i.e., they must be competent to do the job) and they 
must be prepared to partner with others when necessary. Is 
there evidence, for example, that the faculty and staff involved 
are ready to move the project forward in a timely manner? 

Successful projects build on an established skill set. For 
example, faculty who have some experience with computer- 
based instruction beyond putting syllabi on the Web are more 
likely to succeed than others. Such experiences include devel- 
oping outlines and storyboards for pilot modules; developing 
computer-based tutorials and diagnostic quizzes and assign- 
ments keyed to questions in the quizzes; and using course 
management systems that facilitate student-to-student and 
student-to-instructor communications. 

The course's expected learning outcomes and a 
system for measuring their achievement must 
be identified. 

Successful large-scale redesign efforts begin by identifying 
the intended learning outcomes and developing alternative 
methods other than lecture/presentation for achieving them. 
The curriculum is then built backward from the intended 
outcomes. Many redesign efforts take advantage of national 
standards and normed assessment instruments in their par- 
ticular disciplines as a framework for structuring the project. 



Many campuses have established an assessment culture, 
making it easier for them to assess the learning outcomes of 
innovative projects as well as for those of traditional courses 
and programs. Does the campus have assessment processes 
in place, such as the ability to collect data, the availability of 
baseline data or the establishment of long-term measures? 

Is there a system for measuring the achievement of outcomes 
at both the individual student level and the class level? 

The faculty members involved must have a good 
understanding of learning theory or access to 
expert partners. 

Sound pedagogy is the key to successful redesign projects. 
When sound pedagogy leads, technology becomes an enabler 
for good practice rather than the driver. Does the instructor 
seek to use technology to transform the teaching and learning 
environment to achieve learning improvements rather than 
merely to automate existing instructional practice? Has the 
instructor systematically thought about and investigated 
alternative methods for empowering students to learn? 

Faculty who already provide a range of options for achieving 
required learning outcomes are especially good candidates. 

Frequently, one assumes that university faculty have an 
understanding of learning theory simply because they are 
teachers. In reality, many are exposed to these ideas for the 
first time during faculty development experiences. Through 
working in partnership with instructional designers, faculty 
can become knowledgeable about learning theory and its 
relationship to course design. 

In order for the innovation to be self-sustaining 
in the future, one must have a business plan to 
support the ongoing operation of the redesigned 
course. 

In order to be sustained, changes in instructional practice 
must be affordable by institutions and integrated into their 
base funding practices. A wealth of experience shows that 
attempts to add on innovations with external support and 
without internal structural change — especially commitment 
of resources in the institution’s core budget — have been 
almost totally unsuccessful. When the grant funding runs out, 
the innovation ends. The most surefire way to tell whether an 
innovation is for real or is artificial is to look at its funding. 
Unless an innovation is paid for directly by those who stand 
to benefit from it, its chances to flourish are dubious at best. 
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Case Study: Rio Salado College 

Increasing Retention in Distance Learning 




Rio Salado College, one of the 10 community colleges in 
the Maricopa Community College District, has embraced 
the concept of learner-centered education for decades. 

The college was established in 1978 to provide working 
adults with flexible, convenient learning opportunities. 
Since the college does not have a campus, courses and 
programs are offered at more than 250 locations 
throughout the roughly 9,226 square miles of Maricopa 
County, Arizona. 

Rio has also been involved in distance education for the 
last 20 years and in online education for the last three 
years. Currently, 80 percent of its general education 
courses are delivered via technology. Rio begins each of 
its distance learning courses 26 times a year. This means 
that students never have to wait more than two weeks to 
start a class. In addition, although each distance course 
is advertised as a 14-week class, students are allowed to 
accelerate or decelerate as needed. 

Every course offered in the Maricopa District is based 
on a set of required competencies created by a council of 
discipline representatives from each of the 10 colleges. 
Rio Salado, like its sister institutions, designs its distance 
courses around these district competencies. Most of the 
colleges use the "one instructor, 35 students" model. 
Instructors, either full-time or adjunct, deliver content, 
grade assignments, evaluate student progress and overall 
success, and assign final grades. Even though students 
can enroll in classes every two weeks, Rio's "traditional" 
instructional delivery model is similar to that of the 
classroom. One instructor, responsible for a maximum 
of 35 students, answers student questions, evaluates 
student progress and overall success, and assigns final 
grades. 

Rio plans to redesign Introductory Algebra, the starter 
course for students who need to complete College 
Algebra, third on the district's list of top 25 
enrollment courses. The college is in its second year 
of using the Internet and interactive CD-ROM technol- 
ogy developed by Academic Systems to deliver its pre- 
algebra and college algebra courses. Despite the fact 
that completion rates for the Academic Systems-based 
math classes have showed a significant increase over the 
completion rate for print/mixed media (from 39 percent 
to 50 percent), the low completion rate is a matter of 
continuing concern. These low completion rates are not 



unique to Rio Salado but rather are exhibited by the other 
Maricopa colleges as well. 

The redesigned course will continue to use interactive 
software from Academic Systems to deliver content. In 
its first iteration, the majority of instructor time was 
spent troubleshooting noncontent technology problems 
(such as navigation within the lessons), student movement 
through the material (such as when to take tests), and 
student advisement (such as whether to withdraw), rather 
than assisting with learning. The redesign will add student 
assistants to troubleshoot technology questions, monitor 
student progress using Academic Systems' built-in course 
management system, and alert instructors to student 
difficulties with the material. A Help Desk system will be 
developed to support TA-instructor-student communica- 
tion. Instructors can then focus on creating a successful 
start for students and intervening to provide academic 
help when needed. With enhanced, proactive support, 
retention is expected to increase by 20 percent. 

Distance learning classes at Rio Salado College are 
designated as open entry/open exit classes. Because of 
this designation, the college receives only half funding for 
distance learning students who withdraw. Mathematics 
courses tend to have higher withdrawal rates because of 
the nature of the subject matter. Improved retention and 
decreased withdrawal rates in online mathematics courses 
will definitely reduce college costs. 

The restructuring will also permit increasing the number 
of students that can be served in a distance learning 
format. Significant savings can be achieved by increasing 
class capacity from 35 to 100 students per instructor, an 
increase which is possible once non-academic duties are 
shifted to student assistants and other kinds of support. 
Savings will also result from reducing the number of 
students who need to re-take the course. By using tech- 
nology to its full capacity within the course structure, 
redesign will result in a projected cost-per-student 
reduction of 33 percent compared to traditional MCCD 
classroom instruction and 41 percent compared to 
previous distance learning formats at Rio. 
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Improving Student Learning 



After determining that the institution is ready and selecting 
an appropriate course, the next planning step is to identify the 
academic problems that the redesign intends to address. Most 
of the weaknesses attributed to large introductory courses are 
generic in nature and have as their source the limitations of 
the predominant form of instruction in our nation’s colleges 
and universities, the didactic lecture. The overwhelming body 
of research tells us that students do not learn effectively from 
lectures (Halloun 8c Hestenes 1985; Thornton 1990; McNeal 
& D’Avanzo 1997; Mazur 1997; Seymour 8c Hewitt 1997; NISE 
1999.) Testimony from the field corroborates the 
literature. 

What's wrong with the lecture? 

The lecture method is a push technology. It treats all 
students as if they were the same — as if they bring to the 
course the same academic preparation, the same learning 
styles, the same motivation to learn, the same interest in the 
subject, and the same ability to learn. The reality is that 
students with weak skills need more individual attention and 
more opportunity for interaction, particularly at the begin- 
ning of the semester. At the same time, students with strong 
skills who would benefit from having more opportunity to 
explore the material fully or who could accelerate are locked 
into a fixed time frame for completing the course. The large, 
impersonal lecture format simply cannot accommodate the 
broad range of student differences. 

Because the lecture method is largely a one-way technology, 
it is impossible to employ a variety of sound pedagogical 
techniques. Most lecture courses are notoriously ineffective in 
engaging students. The traditional format neither encourages 
active participation nor offers students an opportunity to 
learn collaboratively from one another. Relying heavily on 
reading assignments leads to inadequate student interaction 
with learning materials, a particular deficiency in those 
subjects requiring hands-on experience. This one-way 
methodology does not provide adequate tutoring assistance; 
consequendy, students receive litde individual attention. Even 
though individual help may be available in office hours, only 
a small fraction of students take advantage of them. Most 



students simply study the text, turn in their homework, and 
take quizzes and exams. Adding to the lack of feedback is the 
way in which most test answers are graded: students receive 
only the total score and never know what material was 
incorrect or where to learn the correct information. 

As a result, in many institutions attendance at large lecture 
sections averages approximately 50 percent compared to 
attendance in moderate-sized sections, where it may be better 
than 75 percent. Some students drop out of the course while 
others stay registered but essentially give up and stop working 
after the deadline to drop the course. While success rates vary 
by institutional type and by the subject matter of the course. 
Research I universities commonly cite a 15 percent rate of 
drops, D grades and failures. Comprehensives report success 
rates (a grade of C or better) ranging from 78 percent to 
55 percent in these courses. Community colleges frequently 
experience retention rates of 60 percent or less. Clearly there 
is a great deal of room for increasing student achievement 
levels in these courses. 

Even more important, those who pass often do not retain 
much of the material for future use in other courses. All 
institutions report the inability of students to retain what they 
have learned in large lecture courses and, more specifically, 
the inability of students to apply principles learned to other 
disciplines. Lee Shulman has described those learning prob- 
lems as the “epidemiology of mislearning” or the “taxonomy 
of pedago-pathology.” Students forget what they learned 
(amnesia); they don’t understand that they misunderstand 
what they learned (fantasia); and they are unable to use what 
they learned (inertia). 

There are other nongeneric problems connected to the 
lecture method including lack of accessibility, special 
problems in serving English as a second language learners 
and the inconsistent quality of TA support. Many student 
populations are differentiated by on-campus residency and 
commuting status. The lecture format presents problems to 
students who cannot attend on a regular basis. Institutions 
with a large proportion of English-as-second-language stu- 
dents face special problems since those students often have an 
especially difficult time with courses requiring considerable 



14 




15 





IMPROVING LEARNING ANO REDUCING COSTS: REDESIGNING L A R G E- E N R 0 L L M E N T COURSES > 



language facility and use of technical terms, particularly when 
they are taught in a stand-up format. Conversely, many teach- 
ing assistants who provide the direct contact with students in 
recitation sections and labs are not native speakers of English 
and often find it difficult to communicate with beginning- 
level students. Other large lecture courses are forced to rely 
heavily on TAs who do not have undergraduate degrees in 
the field of study, thus limiting the effectiveness of the 
instruction they can provide. Finally, many courses have no 
TAs at all and consequently offer no resources to support 
learning other than the large lecture. 

Finally, the primary alternate structure for large-enrollment 
courses, the multiple section model, suffers from problems 
of its own. While allowing greater interaction with students 
in theory (although in practice these sections are often quite 
large and are dominated by the same presentation tech- 
niques), the multiple section model suffers from a lack of 
coordination. Whether taught by tenured faculty, instructors, 
adjuncts, or graduate teaching assistants, this model requires 
each instructor to develop his or her own set of course 
materials, including tests and examinations, and to deliver 
what is basically the same material in his or her own style. 

As a result, course outcomes vary considerably and, more 
important, are not always consistent with students’ abilities. 
Virginia Tech has found, for example, that multiple sections 
with no common approaches produce a remarkable lack of 
uniformity in outcomes. Course grades across sections often 
bear surprisingly little statistical relation either to input — 
such as SAT profiles — or to scores on the common final 
exam. Finally, when courses are taught this way, there is no 
ability to pool the intellectual resources of the faculty to 
achieve the best course design and to institute continuous im- 
provement practices. 

The irony of this situation is that lectures are used most 
frequently in introductory subjects with the weakest students 
(read nonmajors) while small, interactive courses predom- 
inate in those courses with the strongest students, (for 
example, the senior seminar.) 

The goals of redesign 

The purpose of course redesign is to improve student 
learning. Consequently, redesign must adhere to sound 
pedagogical principles. Just as there is a substantial body of 
knowledge about the limitations of the didactic lecture, so too 
is there ample evidence about those pedagogical principles 
that result in increased student learning. Much is also known 



about the role of information technology in supporting those 
principles of good pedagogical design — what works, and what 
does not work. If instructors merely add on technology to in- 
effective instructional methods — if they simply technologize 
the lecture method — there will be no improvement in student 
learning. 

Conversely, while it is true that teachers using paper-based 
systems can employ effective instructional methods, such 
an approach tends to increase the teaching’s labor-intensive 
quality. To illustrate this point. Jack Wilson has described 
how a faculty member at Rensselaer tried to demonstrate that 
he could teach an introductory calculus course using all of the 
positive pedagogical techniques utilized in the studio method 
but without using technology. After two years, he was burned 
out and begging for a sabbatical. In addition, there was a high 
institutional cost for the service of the four TAs needed to 
grade his worksheets. Furthermore, his model was not 
diffused; no one adopted it. 

Good pedagogical practice enhanced by technology supports 
shifts in the nature of the teaching-learning enterprise, 
making it more active and learner-centered. Alternatives 
that improve quality involve, among other things, shifting 
repetitive tasks from instructors to IT-based resources and 
developing IT-based interactive materials. Technology can 
be deployed to optimize sound pedagogy by making it more 
consistent, by providing additional practice and examples and 
rapid performance feedback, and by making more instruction 
available on-demand. Technology can provide tools that 
replace, augment, or extend the ability to identify, collect, 
organize, integrate, and generate knowledge. Technology can 
also support models and approaches that change in kind the 
nature of the teaching-learning enterprise. In effect, the new 
approaches and mechanisms stand as a new paradigm for 
student learning. 

Some subjects are particularly well-suited to computer- 
mediated techniques. A large part of the content of many 
introductory courses consists of codified knowledge that must 
be mastered before more complex systems can be understood. 
Introductory level mathematics, for example, typically 
involves a modest conceptual core, underpinning a great deal 
of numerical and symbolic calculation. Interactive computer 
instruction is a natural way to provide examples and practice 
in implementing the ideas, especially where practice efforts 
and repetition count toward mastery of content. Those 
subjects that require hands-on experience with data analysis 
and collection such as statistics and other research-based 
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disciplines can easily take advantage of available technologies 
as a way of teaching concepts and techniques. Most statistical 
skills can be practiced and evaluated on the computer. Any 
portion of a course that concentrates on skill acquisition can 
benefit from an IT format. 

Other subjects that are particularly well suited for technology- 
mediated learning include those that are visual in nature — 
where many of the concepts are illustrated by images. Because 
many students at the introductory level are nonmajors, they 
have an especially great need to see the material that is taught. 
Biology, for example, is rich in graphics and uses many visual 
cues. Its many phenomena are good subjects for animation 
that can capture essential or otherwise unobservable parts of 
the phenomena. Astronomy is another such example. Much of 
current astronomical research is carried out through analysis 
of images. The Web is already rich with astronomical images, 
animations, and Java applets to illustrate its concepts. With 
technology resources and a good roadmap, students can be 
given a rich exploratory experience using materials that are 
already available. 

Most redesign projects involve significant structural change. 
Some eliminate some lectures; others eliminate all lectures. 
The premise is that faculty do not need to spend as much time 
(or any time) presenting information. Lectures are replaced 
with a variety of learning resources, all of which involve more 
active forms of student learning or more individualized assis- 
tance. Redesign involves moving from a push strategy, which 
presents all material to all students in the same way and at the 
same time regardless of their particular needs, to a pull 
strategy. Students access the material they need when they 
need it, an approach that takes into account differences in 
learning styles and abilities. The latter strategy is not only 
more effective in dealing with learning issues; it is also more 
economical in dealing with resource issues because students 
use only as much resource as they need. 

The primary goal is to shift students from a passive, note- 
taking role to an active learning orientation in order to 
enhance learning outcomes. As one math professor puts it, 
“Students learn math by doing math, not by listening to 
someone talk about doing math.” In moving from an entirely 
lecture-based to a student-based approach, learning is less 
dependent on the instructor conveying words and more 
driven by students reading, exploring and solving problems. 



Students are responsible for their learning in that they are 
expected to construct their own knowledge by working indi- 
vidually, with other students, and with instructors. 

What are some of the more active forms of learning that 
replace presentation formats? First, Web-based resources 
that have as their goal greater student engagement with the 
material are one example. Interactive tutorials and exercises 
give students needed practice; computerized, low-stakes 
quizzes provide immediate feedback, repetition, and 
reinforcement; technology-based rnalerials teach abstract 
concepts interactively. Technology-based instruction enables 
students to explore material independently and can be 
structured so that students are compelled to keep up with 
reading and lecture material (self-paced with deadlines). 
Because the materials are always available online, students 
have opportunities to refresh their knowledge when needed. 

Second are techniques that enable greater individualization 
of instruction. By providing 24 x 7 access to online learning 
resources, these new environments are both accessible and 
flexible and allow students to study at times most convenient 
to them. By using self-paced interactive learning materials 
that include diagnostic self-assessments, for example, the 
more self-motivated and more advanced students can rapidly 
move ahead on their own, while the students with less apti- 
tude and knowledge can adjust their learning progress more 
appropriately. Learning many introductory subjects typically 
involves reaching a threshold of understanding, over a period 
that varies widely among students, after which the ideas seem 
easy. IT provides an individualized setting that is well suited 
to this learning pattern. Greater individualization can also be 
achieved by modularizing materials and incorporating exam- 
ples from various disciplines so that students with different 
professional and personal goals have a greater variety of 
learning resources. If students are having difficulty under- 
standing a particular part of the course, it can be changed and 
improved in real time. 

By moving presentation of material and assessing student 
mastery of it to the technology, faculty and teaching assistants 
are freed to spend more time providing individualized assis- 
tance where and when it is needed. A goal of redesign is to 
allow faculty to spend more time with student questions and 
necessary student intervention and less time delivering 
content. In this setting, faculty are able to have more one- 
on-one contact with individual students and thus can more 
readily address the different needs of individuals. Students 
can be challenged according to their own skill levels. 
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It would be a mistake to assume that technology-based 
redesigns consist of individual students sitting in front of 
screens. Many redesigns incorporate collaboration as a 
central feature. The University of Colorado at Boulder, for 
example, plans to redesign its introductory astronomy course 
using technology. A key feature of the redesign will be to 
divide the students into learning teams of nine each. Each 
team will meet with an undergraduate coach in a dedicated 
computer classroom for two hours per week where they will 
explore computer-based materials, discuss the posted ques- 
tions, help each other with homework problems and prepare 
challenge questions for the rest of the class. Students will be 
graded not only on their individual performance, but also on 
the performance of their learning teams. Learning teams will 
earn team credit for their responses to questions, for partici- 
pation in dialogue, and for posing good challenge questions. 

Taking as its cue the use of teams in leading MBA programs, 
the University of Illinois at Urbana-Champaign is redesigning 
an introductory economics course by having students work 
in teams throughout the semester. Scheduled discussion 
sessions will be used for team meetings rather than for 
presentation of content in order to ameliorate the matching 
schedule problem. Student teams will receive training not just 
in how to use the various software in the course, but also on 
how to make the teams function most effectively. Once the 
teams are formed, all work other than examinations will be 
assessed on a team basis. Penn State plans to take a similar 
approach in its planned redesign of statistics. 

With multiple options for learning at their disposal, all 
students are able to concentrate their efforts on those 
materials and pedagogies that best match their learning styles. 
By enabling students to take control of their learning through 
technology-mediated materials, a single course can more 
effectively serve a broad range of student learners. 

But do they really learn? 

When planning to assess large-scale redesign projects, one 
must distinguish between impact — finding out whether the 
ultimate goals of an alternative method (better learning at 
lower cost or the like) were accomplished — and implemen- 
tation — finding out whether the institution actually did what 
it said it was going to do. In any innovation/action research 
project, both are important. 

To assess impact, it is important to be clear about what one 
is after conceptually. The real premise of the redesign 
strategy — and that which ought to be assessed — is not just 



learning but learning productivity. This conceptual framing of 
the dependent variable has several important implications. 
First, the perspective of analysis by definition consciously 
compares the innovation(s) against an established baseline 
of current practice. This implies collecting data on learning 
and costs in both innovative and comparable standard prac- 
tice settings, such as comparing outcomes directly for a tech- 
nology-enhanced course with those of a course delivered in 
the usual way. Second, the variables used in the comparison 
to define impact need to include both learning outcomes and 
later behavior — things like retention rates, course completion 
rates, and the like — as the latter can significantly impact the 
learning productivity equation even if learning outcomes are 
equivalent. 

Peter Ewell, Senior Associate at the National Center for Higher 
Education Management Systems, suggests four specific 
assessment techniques to answer the question, did they really 
learn? 

Matched Examinations. Usually these are final examinations 
administered in common to students completing both 
technology-intensive, redesigned sections and traditional 
sections of the same course. This classic evaluation design 
is the one that has been used the most in assessing both tech- 
nology-based and distance-delivered courses. Because it is 
often hard to get agreement on common exams among differ- 
ent faculty, it is possible just to use a portion of the exam to 
contain some common items. It is also useful to have collected 
some baseline information on the participants to see if the 
treatment and control groups are really similar, such as prior 
GPA, major field, and demographics. 

Student Work Samples. This is a kind of fail-back position 
from the former that relies on existing student products, such 
as papers and problem sets, produced as a part of each course. 
One needs to choose only a few examples, such as one term 
paper and a short essay or a lab report, or a synopsis of an 
article that is roughly comparable, although one virtue of 
this technique is that the items do not have to be completely 
similar. This too can be done on a sample basis rather than 
collecting everything. Once a reasonable sample (n=20 or so) 
from each class is assembled, the pieces can be cross-scored 
by a reading team using a scoring guide to look at things like 
communications ability, mastery of particular areas of 
knowledge, and so on. 

Behavioral Tracking. This approach relies on following 
students who were enrolled in parallel sections (innovative 
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and traditional) through student records to see what 
happened to them later. Several dimensions of behavior are 
especially useful to look at here, including: 

> Course completion rates. If the same learning 
occurs with greater rates of completion, an oft- 
reported finding for well-delivered technology- 
enhanced courses, the result is greater learning 
productivity. 

> Program completion/graduation. Prior analysis 

has suggested that often some clearly identified killer 
courses are responsible for much dropout early on. 
Again, greater learning productivity results if 
retention goes up. 

>" Grade performance in subsequent courses for 

which the target course is a prerequisite. The value 
of this approach can really be enhanced if one can 
find a way to identify the types of mistakes students 
make in subsequent courses, then feed this back to 
prior course instructors for greater emphasis. 

Attitudinal Shifts: This approach relies on student testimony 
about changes in their own levels of confidence about the 
material and/or their motivation to continue in the subject 
area. Again, it is not satisfaction in the feel-good sense but 
rather focuses on attitudes that are likely to be directly related 
to subsequent persistence and time on task. For example, 
several problem-based math courses have detected decreases 
in math anxiety as a result of self-paced, problem-oriented 
course delivery using technology, with the effect surfacing 
later in trying another math course. If such data are collected 
(by end-of-course evaluation survey) they should probably be 
checked against actual later behavior. 
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Case Study: University of Illinois at Urbana-Champaign 

Doubling Enrollment in Intermediate Spanish 




At the University of Illinois at Urbana-Champaign 
(UIUC), and at most universities nationwide, the demand 
for Spanish-language courses far exceeds actual enroll- 
ment, primarily because the ability to staff those courses 
is limited. The demand is fueled by the increasing interna- 
tionalization of our economy. Students who wish to have 
a minor in international studies need competency in a 
second language, and Spanish is the language of choice. 
On the UIUC campus, the Spanish problem will be exac- 
erbated by a recently imposed increase in the foreign- 
language requirement. 

Though much of the demand for Spanish is in the intro- 
ductory courses, Spanish 210, an intermediate-level 
grammar course, has also had a chronic excess-demand 
problem. There are students who have wanted to take the 
course but who have been unable to do so because all the 
slots were filled. 

In 1996-97, an Italian professor successfully developed 
an asynchronous learning (ALIM) approach for her Italian 
101 and 102 courses. She designed vocabulary and gram- 
mar exercises for the students to complete using Mallard, 
a computer-based testing instrument developed by UIUC, 
as welt as writing assignments using FirstClass, a com- 
mercial course-management system. The professor served 
as the course coordinator; graduate TAs taught indepen- 
dent discussion sections. 

Spanish 210, a basic course in Spanish grammar, has a 
similar structure to Italian 101 and 102. The idea behind 
the Spanish course-redesign project was to build on the 
course-development experience of the Italian professor. 

To initiate this project, the Italian professor searched the 
Spanish faculty for a willing participant, ultimately 
enlisting the Spanish 210 course coordinator. The search 
occurred in spring 1997 in response to a call from the 
Sloan Center on Asynchronous Learning Environments 
(SCALE) administration. 

In its traditional format, the Spanish course met in three 
lecture/discussion sections per week for 15 weeks. The 
114 students were divided into six discussion sections 
of 19 students each taught by teaching assistants. One 
professor coordinated the course, supervised the TAs 
and prepared quizzes and exams. Three TAs taught two 
sections each per semester and graded all quizzes and 
exams. 



In the fall 1997 semester two sections of Spanish 210 
were taught primarily online utilizing both FirstClass and 
Mallard. The online sections met only once a week while 
the traditional sections met three times a week. In fall 
1997 the use of these techniques allowed the department 
to increase class size from 19 students to approximately 
38 students in each of the two sections. In spring 1998 
all sections of Spanish 210 were taught using these tech- 
niques and all have experienced a doubling of enrollment 
relative to historical norms. 

The redesigned course enrolls 228 students with 38 stu- 
dents in each of six sections. Each section meets for one 
hour per week; the rest of the course takes place online. 
The course coordinator continues to supervise the TAs 
and prepare quizzes and exams; she also handles student 
problems, course logistics, and course material updates. 

The role of the TAs has changed considerably. In addition 
to meeting students in a one-hour lecture/discussion 
session per week, TAs spend about three hours per week 
assessing online writing and now hold a two-hour office 
hour session each week to provide individualized assis- 
tance. Student attitudes toward the new format are posi- 
tive since their time is being used more effectively. They 
can control the pacing of the work within the deadlines 
set by the professor, and the time they spend in class is 
not wasted in the way that it often was in the old recita- 
tion sessions. 

The department believes that by using online techniques 
to teach all sections of Spanish 210 in the future, they 
will be able to teach approximately twice as many 
students without adding personnel. In the traditional 
course, the cost of teaching 114 students was $22,750 
per semester for a per-student cost of $200. The cost of 
teaching 228 students in the redesigned format is 
$23,025 per semester for a per-student cost of $101 in 
the redesigned course. Thus, the savings per student is 
about $99, which translates to a per-semester savings of 
$22,475. 
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Instructional Task Anaylses and Financial Planning 



Since the major cost item in instruction is personnel, we know 
that reducing the time faculty and other instructional person- 
nel spend and transferring some tasks to technology-assisted 
activities is the key to cost savings in instruction. If we can 
reduce the number of hours spent by faculty and others while 
keeping credit hours constant with no diminution of learning 
results, we can reduce costs while maintaining quality. Of 
course, it is possible to reduce contact hours and save money, 
but without the use of IT and the redesign of the instructional 
process, quality would most certainly decline. W ith technol- 
ogy, one can serve the same number of students at a lower 
cost — and serve them more effectively. 

In redesigning large-enrollment courses, there are, of course, 
a variety of ways to reduce costs and, consequently, a variety 
of instructional models that can be developed depending 
upon institutional circumstances. One approach is where 
student enrollments stay the same but the instructional 
resources devoted to the course (course expenditures) are 
reduced. This approach makes sense when the demand for the 
particular course is relatively stable. Another approach is to 
increase enrollments with little or no change in expenditures. 
This technique is appealing to institutions that face greater 
student demand than can be met using conventional meth- 
ods. A third way is to reduce the number of course repetitions 
required to pass a particular course. In many community 
colleges, for example, it takes an average of 2. 5 enrollments to 
pass introductory mathematics courses. This means that the 
institution and the student must spend 2.5 times what it 
would cost to pass the course on the first try. In each of these 
cases, a translation of the savings to cost-per-student can be 
used for comparative purposes. 

In the case studies included in this paper, the University of 
Wisconsin-Madison intends to maintain the same student 
enrollment in general chemistry while reducing the instruc- 
tional resources that are devoted to the course. The University 
of Illinois at Urbana-Champaign plans to increase enroll- 
ments with litde or no change in expenditures. This technique 
is appropriate given the high student demand in Spanish. 
Without this redesign, the university would not be able to 
serve its students adequately using conventional methods. 
Virginia Tech intends to do both: to increase student 



enrollments while decreasing the resources devoted to the 
course. Rio Salado College expects to increase enrollments 
in a distance learning course while simultaneously reducing 
the number of repetitions required to pass their introductory 
mathematics course. A translation of the savings to the 
cost-per-student allows one to compare the results of each 
approach. 

Regardless of the particular method employed, a necessary 
first step is to look at the different instructional tasks that 
are involved in course design and to analyze the cost of both 
the traditional method of instruction as well as the new 
method of instruction utilizing technology. This analysis 
utilizes activity-based costing, a process generally regarded 
in higher education as difficult and unpopular. One must go 
through the process of activity-based costing in order to gain 
a clear understanding of the source of both costs and potential 
savings. Doing activity-based costing is not too difficult at the 
course level, particularly with a prestructured format to 
facilitate the process. 

Activity-based costing involves the following steps. 

1. Identify the tasks associated with preparing and offering 
the course in a traditional format and the categories of 
personnel involved. 

2. Determine all personnel costs expressed as an hourly rate. 

3. Determine how much time each person involved in 
preparing and offering the course in a traditional format 
spends on each of the tasks. 

4. Repeat steps 1 through 3 for the redesigned course format. 

5. Compare the two costs and calculate the savings. 

(Please see the sample spreadsheets on the following page for 
an illustration of this process.) 

Instructional tasks fall into two categories: course develop- 
ment and course delivery, both of which are performed by 
a variety of kinds of instructional personnel. There are four 
major activities associated with developing a course: curricu- 
lum design, materials acquisition, materials development, 
and preparation/training of instructional personnel. Curricu- 
lum design and development involves planning the overall 
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INSTRUCTIONAL COSTS OF TRAOITIONALXOURSE?;" 



Faculty Hourly Rate=$132 


TAs/GAs Hourly Rat 


e=$23 


1. COURSE PREPARATION 
A. Curriculum Devetopment 


#OF Hours 


Total Cost 


# OF Hours 


Total Cost 


B. Materials Acquisition 










C. Materials Development 










1 . Lectures/presentations 


60 


$7,900 


464 


1 $10,610 


2. Learning materials/software 










3. Diagnostic assessments 










4. Assignments 










5. Tests/evaluations 


12 


$1,580 


88 


$1,993 


Sub-Total 

D. Faculty/TA Development/Training 


72 


$9,480 


552 


$12,503 


1 . Orientation 






240 


$5,436 


2. Staff meetings 


15 


$1,975 


120 


$2,718 


3. Attend lectures 






240 


$5,435 


Sub-Total 


15 


$1,975 


600 


$13,590 


Total Preparatbn 


87 


$11,455 


1,152 


$26,093 


II. COURSE DEUVERY 
A. Instructbn 










1 . Diagnose skill/knowledge 










2. R-esentatbn 


30 


$3,950 ^ 






3. Interaction 


30 


$3,950 


1,048 


$23,737 


4. Progress monitoring 










Sub-Total 
B. Evahjatbn 


60 I 


$7,900 


1,048 


$23,737 


1 . Test proctoring 


11 


$1,448 


32 


$725 


2. Tests/evaluation 


12 


$1,580 


648 


$14,677 


Sub-Total 


23 


$3,028 


680 


$15,402 


Total Delivery 


83 


$10,929 


1.728 


$39,139 - 


TOTAL 
Support Staff 


170 


$22,384 

$3,806 


2,880 1 


$65,232 


GRAND TOTAL 




$91,421 






Cost per student i 




$261 







To illustrate the planning methodology, this example analyzes a large introduc- 
tory course organized in ei^t 350-student sections. In the tracftbnal course, 
each section is taught by one professor, eight teaching assistants, and four 
support positions for a total semester cost of $9i ,421 and a per-student cost 
of $261. 



By off-loading instructional tasks performed by faculty members and teaching 
assistants in the traditional nxxlel to interactive, computer-based learning mod- 
ules, the redesigned course will cost $69,830 per semester with a per-student 
cost of $200. The savings for orre 350-student section is $2i ,591 ($91 ,421 - 
$69,830): savings per semester (8 sections) is $1 72,730 ($21 ,591 * 8). 



INSTRUCTIONAL COSTS OF REDESIGNED COURSE 





Faculty Hourly Rate=$132 


TAs/GAs Hourly Ra1 


:e=$23 


1. COURSE PREPARATION 
A. Curriculum Development 


1# OF HOURS 


Total Cost 


# OF Hours 


Total Cost 


B. Materials Acquisition 










C. Materials Devebpment 










1 . Lectures/presentatons 


15 


$1,975 


224 


$5,074 


2. Learning materials/software 










3. Diagnostic assessments 










4, Assignments 








1 


5. Tests/evaluations 


12 


$1,580 


88 


$1,993 


Sub-Total 

D. Faculty/TA Devetopment/Training 


27 


$3,555 


312 


$7,067 


1 . Orientatbn 






240 


$5,436 


2. Staff nneetinQS 


15 


$1 .975 


120 


$2,718 


3. Attend lectures 






120 


$2,718 


Sub-Total 


15 


$1 ,975 


480 


$10,872 


Total Preparatbn 


42 


$5,530 


792 


$17,939 


11. COURSE DEUVERY 
A. hstOJCtbn 










1 . Diagnose skill/kncwiedge 










2. Presentation 


30 


$3,950 






3. Interactbn 


30 


$3,950 


808 


$18,301 


4. Progress monitoring 










Sub-Total 
B. Evaluatbn 


60 


$7,900 


808 


$18,301 


1 . Test proctohnq 


11 


$1,448 


32 


- $725 


2. Tests/evaluatbn 


12 


$1,580 


408 


$9,241 


Sub-Total 


23 


$3,028 


440 1 


$9,966 


Total Delivery 


83 


$10,928 


1.248 


$28,267 


TOTAL 
Support Staff 


125 


$16,458 

$7,165 


2.040 


$46,206 


GRAND TOTAL 




$69,830 






Cost per student 




$200 
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INSTRUCTIONALCOSTSPERHOUR< •> : V:. 


FACULTY 




TAs/GAs 




SUPPORT STAFF 




Salary 


$89,538 


Salary for 1 TA 


$32,618 


PosmoN 


Cost PER Hour 


% devoted to instruction 


50% 


% devoted to instruction 


50% 






% devoted to this course 


50% 


% devoted to this course 


50% 


Lab manager 


$19 


$ devoted to this course 


$22,385 


$ devoted to this course 


$8,155 


Technical support 


$29 


Contact hours for course 


30 


Contact hours for course 


116 


Stockroom 


$12 


Out of class hours 


140 


Out of class hours 


244 


Computer room 


$7 


Total hours 


170 


Total hours 


360 






Cost per hour 


|132 


Cost per hour 









Structure of the course including establishing what the 
students will know or be able to do if they successfully 
complete the course; identifying the major topics and learning 
activities of the course and their sequence (course syllabus); 
and determining how and on what basis student learning will 
be evaluated. 

Materials acquisition entails evaluating and acquiring all 
learning materials, both paper-based and computer-based, 
that can be purchased or borrowed from others — in other 
-words, those not-developed by the faculty member(s) 
teaching the course. Materials include cases, workbooks, 
texts, instructional software, course-management software, 
diagnostic assessments and other kinds of tests and evalua- 
tions. Materials development consists of the time spent by 
the faculty member(s) and all others associated with course 
development (TAs, professional staff) to develop the learning 
materials used in the course including lectures and other 
classroom presentations, assignments, diagnostic assess- 
ments, tests, and other forms of evaluations. 

If the course is supported by TAs or adjuncts, supervising 
faculty must spend time orienting and training them. TAs 
frequently must attend lectures as part of their preparation to 
lead recitation sections. Staff meetings related to the specific 
course maybe required for courses involving more than a 
single faculty member, such as team-teaching. 

Instruction and evaluation are the activities associated with 
the delivery of the course. Instruction encompasses in-class 
and out-of-class administration of assessment instruments; 
presentation of materials, (lectures); nonpresentation 
interactions with students (in-class discussions, office hours, 
and laboratory sessions); and time spent monitoring the 
progress of individual students. Evaluation activities include 
test procuring and out-of-class time spent grading assign- 
ments (homework, labs, exercises), tests, and evaluations. 



By analyzing the amount of time each person involved in 
the course spends on each kind of activity, one can identify 
the cost factors that can be altered. It is obvious, for example, 
that evaluating and selecting textbooks is less labor intensive 
than developing learning materials from scratch. Structuring 
a redesign around interactive software, preferably purchased 
or borrowed, radically changes the amount of time that must 
be spent by faculty and/or TAs in class preparation and 
routine student interactions. Computer-based quizzing 
eliminates the time spent in grading exercises. The analysis 
allows you to do detailed planning, including what-if 
scenarios, to-arrive at the optimal mix of time to be spent by 
the appropriate personnel. 

Comparing operational costs 

This planning model compares operational costs: the before 
costs of the traditional course and the after costs (forecast of 
what the course will cost when it is fully operational, say for 
example, in its third offering). In other words, it asks one to 
plan what the redesigned course will look like at the end of the 
developmental process. It does not include the up-front develop- 
mental costs of either the traditional or the redesigned course. 

There are two reasons for this approach. The first is that the 
goal of planning is sustainability — how to sustain redesign 
efforts over the long haul— and sustainability results from 
permanent changes in operating expenses. The second is that 
while the developmental period for course conversion has 
costs associated with it, the amount of those costs can vary 
widely and can be handled quite differently. They can be paid 
for from one-time allocations, such as grants from founda- 
tions, federal agencies, or the institution, and/or they can be 
amortized over any number of years. If institutions can see 
that they will ultimately realize a return on their investment, 
they will have an incentive to make the needed developmental 
investment. Then, of course, questions about how much to 
invest for how much return come into play. 
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Some development costs are not a one-time thing; there will 
be ongoing development costs as new material comes along. 
Ongoing developmental costs are part of traditional course 
formats as well, so some faculty time will be devoted to 
development in either model and should be included in the 
appropriate task category. When additional personnel — such 
as programmers or database managers — are required, those 
costs need to be accounted for as ongoing operational costs, 
not developmental costs. 

Institution-wide support services and administrative over- 
head are not included in the comparative cost analysis. The 
assumption is that those costs are constant — they are part 
of the campus environment — for both the traditional and 
redesigned courses. Those costs are not being ignored; they 
apply regardless of the course design so they do not need to 
be counted twice. 

Excluding campuswide infrastructure costs 

Campuswide infrastructure and equipment costs are not 
included unless the item is specific to the particular course. 
Campus networking, site licenses for course management 
systems and desktop PCs for faculty, for example, are part of 
the campuswide IT environment. (Software, equipment and 
professional staff that are particular to the specific course, 
however, are included.) This point deserves further elabora- 
tion because it often raises questions in the minds of non-IT 
executives. 

There are three reasons for not including the cost of infra- 
structure in the planning model. 

1. Universities and colleges are investing (and will continue to 
invest) in IT infrastructure and support — as are all businesses 
and organizations — because it is a necessity for doing 
business in the 21st century. Ifwe never redesign courses to 
take advantage of this investment and continue to add IT on 
to existing academic and administrative practices, the invest- 
ments (and the cost increases) will continue — for communi- 
cations, for research, for library and other student services, 
and for supporting traditional academic practices. So the 
investments will continue to be made. The point of the 
planning methodology is to show institutions that by taking 
advantage of that infrastructure to redesign courses and save 
primarily on personnel costs, they can receive a return on 
their infrastructure investment. 

2. Even ifwe include the cost of IT infrastructure and institu- 
tional support staff in the cost model, it would be a minor 



fraction of the course costs. Eighty percent of institutional 
costs are personnel; IT is generally between 3 and 5 percent of 
the institutional budget. So, for example, ifwe calculated the 
introductory chemistry course’s share of the University of 
Wisconsin’s infrastructure (which has multiple uses as 
indicated above), it would be a tiny, tiny fraction of the cost 
of the course. 

3. The major information technology corporations — includ- 
ing AT&T, IBM, Sprint, MCI-WorldCom, and Microsoft — are 
spending trillions of dollars over the next decade to upgrade 
and enhance the nation’s and the world’s telecommunications 
infrastructure. The consequence of this investment is to 
reduce dramatically the cost of telecommunications infra- 
structure while simultaneously increasing the capability of 
smart software. Compared to five years ago, the cost of a full 
function PC has dropped from about $1,500 to $600 and the 
capability of that PC has increased even more (80 to 400 MHz 
processor speed, 40 to 4,000 MB disks, 512 to 64,000 KB 
RAM). Long-distance phone rates have dropped from 25 to 
less than 10 cents a minute, average Net connectivity has risen 
from 9.6 to 56 Kbps, cable companies are offering connectivity 
at megabit speeds for less than $40 a month, and we have yet 
to reach the market-clearing price. It would be less than clever 
if higher education did not try to leverage those investments 
by the corporate world. The marginal cost to add teaching and 
learning applications to our campus infrastructure is almost 
nothing and clearly pales beside the cost of human mediation. 
The argument is like investing in 40 IK plans: if one’s 
employer is going to do an order-of-magnitude-better match 
to the employee contribution, one would be foolish not to 
contribute. 

Some believe that savings in instruction cannot compensate 
for research and administrative investments which, at most 
R1 universities, is funded in large part out of ICR funds. These 
campuses look to the research return — in prestige and future 
ICR — as a primary justification for the investment. Adminis- 
trative computing is a second huge factor. Gains from instruc- 
tion are tertiary and quite distant from the first two. If the 
point of the planning methodology is to rationalize the overall 
investment by gains in instruction with an audience of 
campus administrators, it will not be a convincing argument. 

The counterargument to this analysis is as follows. On most 
R1 campuses, the research budget is 10 to 15 percent of the 
total and the administrative budget is 5 to 10 percent (subject, 
of course, to the criticism that nobody really knows how much 
goes into anything because of hidden cross subsidies). It is 
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the classic 80/20 problem: 80 percent in instruction and 20 
percent in the rest. The rest (research and administration) 
take a significant interest in the bottom line, but generally 
instruction does not because such a large percentage of its 
costs are presumed to be fixed — salaries, building mainte- 
nance, and student support services. (In point of fact, 25 years 
ago similar arguments were made about research and 40 years 
ago they were made about administration). If those costs are 
fixed, then the argument might hold together. If instructional 
costs are not fixed, then a 10 percent reduction in those costs 
is worth four times as much as a 10 percent reduction in 
administrative and research costs. Small improvements in 
instructional costs can yield large returns. We ought to be 
looking for cost improvements where the costs are highest. 

What about distance learning? 

This costing model is equally applicable to distance learning 
courses. There is a widespread assumption that distance 
learning delivery is inherently cheaper than classroom 
delivery. In announcing plans to develop the Western 
Governors University, for example, Colorado’s Governor 
Roy Romer was quoted as saying, “This is a revolutionary 
idea. Many people can’t afford the traditional way of getting 
a higher education degree, which is learning by sitting in the 
classroom. Technology can be an effective and cheaper way 
to help people learn.” Governor Romer is right: technology- 
based delivery can be cheaper and more effective. But 
distance learning is not necessarily more cost effective; it 
depends on the design of the distance learning course or 
program. 

A common approach to online learning is the following. Full- 
time faculty design and then offer asynchronous courses or 
asynchronous parts of courses over the Internet. Many faculty 
find this approach educationally sound but also inordinately 
time consuming. Because the medium itself permits active 
participation by all students in every discussion, faculty can 
feel obliged to respond to dozens of student postings each 
day. Whatever the learning virtues of this kind of instruction 
may be, it does not lower per-student costs; it raises them. 

In many ways, this mode is more costly than traditional class- 
room delivery. 

The more one replicates the traditional campus model, the 
more one’s operating costs will resemble or exceed traditional 
campus costs, as in the case of instructor-led models, such as 
televised classes or computer conference-based courses, 
which rely on the same student/faculty contact as traditional 



models. Similarly, if one uses site-based delivery methods 
(versus desktop delivery to the home or office), the same 
borrow-rent-buy facilities issues found on campus will arise. 

The bottom line 

Doing a careful analysis of the instructional tasks associated 
with the traditional course format allows one to gain an 
understanding of those that can be shifted from personnel 
to technology-based materials and those that cannot. After 
determining the pedagogical principles that need to be 
employed in the redesign and the kinds of instructional per- 
sonnel who are essential to the specific tasks, one can experi- 
ment with a variety of redesigns and calculate their associated 
costs. Most academic problems can be addressed in a variety 
of ways; there is no one perfect redesign strategy. The princi- 
ples are generic, however. Cost savings result from shifting 
the time spent by instructional personnel to the technology. 
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IMPROVING LEARNING AND REDUCING COSTS! REDESIGNING L A R G E- E N R 0 L L M E N T COURSES 






Case Study: Rensselaer Polytechnic Institute 

Five Stages of Transformation 




Rensselaer Polytechnic Institute has probably gone 
farther than any other college or university to institu- 
tionalize the kind of large-scale redesign discussed in this 
paper. At the symposium, Jack Wilson, widely regarded 
as the moving force behind the studio course model, 
provided a retrospective on what Rensselaer experienced 
as they migrated numerous courses in many disciplines 
from a lecture format to a learner-centered model. The 
reaction of faculty and the difficulties of sustaining signif- 
icant change received particular emphasis in his presen- 
tation. Jack characterized the stages of this process as 
the movement from resistance to transition to diffusion 
to regression to renewal. 

Resistance 

In the beginning, the attitude of most faculty was "hell 
no, I won't go." Today the prevailing attitude is "hell no, 

I won't go back." When embarking on a process of major 
institutional change, one can expect a certain degree of 
faculty resistance. That should not be a discouragement 
for the positive attitudes of the champions and the power- 
ful impact of these new environments on students will 
inevitably carry the day. 

Transition 

One of the things that made it easier to deal with the 
redesign process and all of changes that accompanied 
it at Rensselaer was that many faculty were unhappy 
with the traditional lecture/lab/recitation format. Many 
mid-career, research faculty were working in an environ- 
ment where they could not be successful. The new format 
combined lecture, lab, and recitation and brought out the 
faculty's strengths as teachers. In addition, an explicit 
goal was to reduce faculty workload; this was achieved 
by the redesign. 

Diffusion 

The next phase was diffusion: how to move beyond the 
innovators. Diffusion of the studio model was uneven 
across the campus. In some departments, such as math, 
physics, information technology, electronic media arts, 
and communications, the impact was pervasive, affecting 
all faculty and all students. In others like biology, chem- 
istry, economics, and other engineering departments, the 
impact was significant but not pervasive. The humanities 
and social sciences were already using many of the inter- 
active techniques being adapted in the studio courses and 



so did not experience much change. All faculty who have 
taught in both forms like the new studio model and would 
not go back to a lecture-based format. 

Diffusion of the studio model beyond the Rensselaer 
campus has been an interesting process. Some institutions 
have adopted most of the strategies without calling the 
result a studio course. Jack believes that you have to give 
people room to create their own forms and to put their 
own spin on the idea. 

Regression 

An important lesson from Rensselaer's experience is 
that backsliding is always a possibility. In physics, the 
department declared victory and moved on and, as a 
result, some of the original redesign focus was lost in 
the introductory course. Ongoing leadership is important 
even when the redesign process is pervasive. A champion 
is needed to provide focus, organize the process, and 
coordinate quality control. 

Sometimes a change of leadership can result in a new 
but not necessarily better model. A new person may want 
to put his or her mark on the department and make 
changes for change's sake. One new faculty member went 
so far as to move the course back to the lecture model, 
and measures of quality and satisfaction went down as 
a result. The course has since been turned over to a new 
faculty member, who has the department back on track. 

Renewal 

It is important to bring in new champions as the process 
progresses. At Rensselaer, leadership on campus has 
moved from math and physics to electrical engineering. 
There is always a need to focus on new Issues, to think 
about taking on the next steps. Rensselaer has moved to 
a student mobile-computing model, for example. In order 
for the studio model to scale, they wanted to make net- 
worked computers available to students wherever they 
might sit down. Providing equipment to reach this goal 
proved to be too expensive. Rensselaer has now adopted 
a policy requiring all students to have a laptop. The 
students bring computers with them when they arrive on 
campus and the university provides the infrastructure and 
a place to connect. The results: a significant reduction in 
cost. 



25 



26 



THE PEW SYMPOSIA IN LEARNING AND TECHNOLOGY 




At the end of the symposium, the participants reconsidered 
the assumptions listed at the beginning of this paper. They 
were asked, does anyone still believe that improving quality 
has to mean increasing costs? No, they said. By employing 
well-thought-out redesigns, it is possible to improve quality 
without adding costs. Does anyone believe that adding infor- 
mation technology always adds cost? Again, the answer was 
the same. And finally they were asked, does anyone still 
believe that using information technology threatens the 
quality of higher education? Again, the answer was the same. 

It depends on the design of the course. 

The participants agreed strongly that the concept of readiness 
criteria is an essential one. Large-scale redesign is not a trivial 
process. It requires a high degree of preparedness in order to 
be successful. Participants noted, however, that as more insti- 
tutions go through the process of redesign, those that follow 
will be the beneficiaries of what the early pioneers have 
learned. 

The group also agreed with placing primary emphasis on 
improving learning when thinking about redesign. Some went 
so far as to argue that if these new environments provide a 
better way to deliver education, why base the argument for a 
cultural change within our college and universities on the fact 
that it will save money? Others countered that there can be no 
quality improvements without controlling costs because 
innovations cannot be sustained without doing so. A wealth 
of experience shows that attempts to add on innovations with 
external support, and without internal structural change — 
especially the commitment of resources in the institution’s 
core budget — have been almost totally unsuccessful. In order 
to be sustained, changes in instructional practice must be 
affordable by institutions and integrated into their base 
funding practices. 

Since the participants became convinced that it is possible to 
enhance learning while reducing costs, at the end of the day 
the discussion returned to one of our starting points: the 
different views of higher education’s stakeholders as to who 
should harvest the savings. Is it the department or the instruc- 
tor, the institution or the students? Legislators would prefer to 
see some, if not all, of the savings passed on to the public or to 



the consumer in some way, by reducing tuition, for example. 
If some or all of the savings are retained by the institution, 
what should be done with them? 

Should the extra resources be reinvested in the course’s 
ongoing development? Perhaps the academic unit should 
capture the savings. Or should the savings be returned to the 
institution to be reallocated for other uses? If the savings are 
captured by the department or by the institution, there is little 
incentive for faculty members to improve productivity by 
increasing enrollment or improving retention. 

Some believe that the faculty members involved in the 
redesign should benefit directly as an incentive or a reward 
for increasing productivity. If the individual instructor 
captures the savings (faculty time), it may mean more time 
to do research or it could mean more time to pursue personal 
interests. How we reward faculty and staff for increased 
productivity is an important consideration. 

Once it is possible for institutions to create a surplus of 
instructional resources rather than simply consuming them, 
we will be forced to rethink many of our assumptions about 
planning and budgeting. A whole host of institutional policy 
issues will be involved as well as numerous practical matters 
having to do with supporting innovation. 

What a great topic for a future Pew symposium! 
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